A quasi-Newton method with optimal r-order without independence assumption∗
نویسندگان
چکیده
Quasi-Newton methods based on least change secant updating formulas that solve linear equations Ax = b in n = dim(x) = dim(b) steps can be expected to solve corresponding smooth nonlinear systems n-step quadratically, i.e. with an r-order of ρ = 2 = 1 + 1/n+O(1/n). The best rate one can possibly expect on general problems is given by the positive root ρn of ρ (ρ− 1) = 1, for which ρn − 1 = ln(n)/n+O(1/n). To show that this upper bound is actually achieved one usually has to impose a priori some kind of linear independence condition on the sequence of steps taken by the quasi-Newton iteration in question. Without any such assumptions we establish in this paper the convergence order ρn for the two-sided rank one formula proposed by Schlenkrich et al in [SGW06]. It requires the evaluation of adjoint vectors, is invariant with respect to linear transformations on the variable domain and combines the properties of bounded deterioration and heredity.
منابع مشابه
A class of multi-agent discrete hybrid non linearizable systems: Optimal controller design based on quasi-Newton algorithm for a class of sign-undefinite hessian cost functions
In the present paper, a class of hybrid, nonlinear and non linearizable dynamic systems is considered. The noted dynamic system is generalized to a multi-agent configuration. The interaction of agents is presented based on graph theory and finally, an interaction tensor defines the multi-agent system in leader-follower consensus in order to design a desirable controller for the noted system. A...
متن کاملThe Sine-Cosine Wavelet and Its Application in the Optimal Control of Nonlinear Systems with Constraint
In this paper, an optimal control of quadratic performance index with nonlinear constrained is presented. The sine-cosine wavelet operational matrix of integration and product matrix are introduced and applied to reduce nonlinear differential equations to the nonlinear algebraic equations. Then, the Newton-Raphson method is used for solving these sets of algebraic equations. To present ability ...
متن کاملAn Unconstrained Minimization Approach to the Solution of Optimization Problems with Simple Bounds
A new method for the solution of minimization problems with simple bounds is presented. Global convergence of a general scheme requiring the solution of a single linear system at each iteration is proved and a superlinear convergence rate is established without requiring the strict complementarity assumption. The theory presented covers Newton and Quasi-Newton methods, allows rapid changes in t...
متن کاملJoint Independent Subspace Analysis: A Quasi-Newton Algorithm
In this paper, we present a quasi-Newton (QN) algorithm for joint independent subspace analysis (JISA). JISA is a recently proposed generalization of independent vector analysis (IVA). JISA extends classical blind source separation (BSS) to jointly resolve several BSS problems by exploiting statistical dependence between latent sources across mixtures, as well as relaxing the assumption of stat...
متن کاملFixed point theorems for generalized quasi-contractions in cone $b$-metric spaces over Banach algebras without the assumption of normality with applications
In this paper, we introduce the concept of generalized quasi-contractions in the setting of cone $b$-metric spaces over Banach algebras. By omitting the assumption of normality we establish common fixed point theorems for the generalized quasi-contractions with the spectral radius $r(lambda)$ of the quasi-contractive constant vector $lambda$ satisfying $r(lambda)in [0,frac{1}{s})$ in the set...
متن کامل